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Xuieo^ j 2h), involving the variance a"^ in phase space of the classical limit distribution of a 
given system. A fortiori, this further bounds the corresponding information-theoretical gener- 
alizations of the quantum entropy proposed by Renyi. 
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5^ ■ 1 Introduction 
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^ Recurrent problems in four dimensional BPS black holes focus on the entropic behavior of the respec- 
■ tive complex structure moduli spaces, and, perhaps independently, on the corresponding holographic 
P-i! entanglement information lost in decoherence, and associated Hawking radiation paradoxes [1] . They 
r-| ! all rely on the fundamental and dependable statistical concept of entropy, which accounts collectively 
for the flow of information in these systems, and for which robust estimates are needed, in lieu of 
detailed accounts of quantum states. Ideally, such estimates would only require gross geometrical and 
semiclassical features of the system involved, and ignore quantum mechanical interference subtleties. 

Classical continuous distributions have been studied in probability and information theory for 
quite a long time, and Shannon [2] has derived handy upper bounds for their entropy, and thus 
crude least information estimates, in the 1940s. Approximate counting of quantum microstates, 
however, is normally toilsome, and can be approximated heuristically by semiclassical proposals |3], 
which, ultimately, should devolve to a bona fide classical limit, despite occasional ambiguities and 
complications along the way [1]. However, a more systematic approach was initiated by Braunss 
[5], who appreciated the underlying simplicity of phase space in taking a classical limit of intricate 
quantum systems. He thus tracked the information loss involved in smearing away quantum effects, 
to argue that the entropy of a quantum system is majorized by that of its classical limit, as h- 
information of the former is forfeited in the latter, an intuitively plausible relation. 

The purpose of the present brief remark is to simply combine the two inequalities into a general 
upper bound of the quantum entropy of a system provided essentially by just the logarithm of the 
variance in phase space of the classical limit distribution of that system. The resulting inequality, eqn 
(Q below, is illustrated simply by the elementary physics paradigm of a thermal bath of oscillator 
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excitations of one degree of freedom, whose phase-space representation is an obvious maximal entropy 
Gaussian. 

Note that there is no specific assumption of a particular spectral behavior — or even of the exis- 
tence of a hamiltonian — for the systems covered by the inequality. Extension to arbitrary degrees 
of freedom and tighter bounds contingent on the circumstances of detailed physical applications 
are conceptually straightforward, even though specific application to the moduli phase spaces or 
holographic entanglement of black holes is reserved for a future, less general, report. 

In passing, and because it fits naturally with the computational technique involved, the corre- 
sponding quantum Renyi entropies [6] are also evaluated explicitly here for the same prototype sys- 
tem, to illustrate the broad fact that these entropies are majorized by the Gibbs-Boltzmann entropy, 
and thus also by the bound discussed here. Renyi generalized entropies were originally introduced as 
a measure of complexity in optimal coding theory [6J, and have been apphed to turbulence, chaos and 
fractal systems, as well as semi-inclusive multiparticle production [3, |B] ; however, apparently, they 
have not attained significance in black hole physics yet, nor in current noncommutative geometry 
efforts. 



2 Shannon and Boltzmann-Gibbs entropy in phase space 

For a continuous distribution function f{x,p) in phase space, the classical (Shannon information) 
entropy is 



For a given distribution function f{x,p), without loss of generality centered at the origin, nor- 
malized, / dxdpf = 1, and with a given variance, = (x^ + P^) = / dxdp^x"^ +p'^)f, it is evident 
from elementary constrained variation of this Sci[f] w.r.t. /, [2j (also see [9]), that it is maximized 
by the Gaussian, fg = exp(— (x^ + p^) / a"^) j a'^n, to = 1 + ln(7rcr^). 

That is, a Gaussian represents maximal disorder and minimal information — in thermodynamics, 
least dispersal energy would be available. 

Thus, it leads to a standard result in information theory [2], Shannon's inequality. 



which provides an upper bound on the lack of information in such distributions. 

Note that, in general, Sd is unbounded above, as it diverges for delocalized distributions, a ^ oo, 
containing no information. In contrast to the Boltzmann-Gibbs entropy, it is also unbounded below, 
given ultralocalized peaked distributions (cr — >^ 0), which reflect complete order and information. 






(2) 
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In quantum mechanics, the sum over all states is given by the standard von Neumann entropy 
|10j for a density matrix p, 

< = -Tr p Inp = -(Inp) . (3) 
This transcribes in phase space fHX E] through the Wigner transition map [12j to 

0<Sq = - J dxdp f In^hf) , (4) 



where the ^-product [TT] 

^ ^ ^^(dxdp-dpdx) 

serves to define ^-functions, such as the ^-logarithm, above, e.g. through ^-power expansions, 

n=l 



Braunss [5] has argued that, for Sd defined by Sq + In h in the limit that the Planck constant 

0<Sq<S,i-\nh. (7) 



The logarithmic offset term relying on the Planck constant h accounts for the scale [3] of the 
phase-space area element dxdp in (jl]). This scale, h, should divide dxdp to yield a dimensionless 
phase space area element; Correspondingly, it should then multiply /, to preserve 'probability', 
J dxdpf = 1, in the Wigner transition map from the density matrix p to the Wigner Function /. 
E.g., for a pure state [12], 

f{x,p) = ljdyr[x- ^y^ e-^y^l^ ^ (^x + \^ . (8) 

The classical limit normally entails variations of phase-space variables on scales much larger than fi. 
Therefore these variables are normally scaled down to scales matched to such activity. As illustrated 
explicitly in the next section, comparing quantum and classical entropies relies on the above offset. 
The upper bound in this Braunss inequality reflects the loss of quantum information involved in the 
smearing implicit in the classical limits, effectively regarded as an extreme limit of subadditivity [3] . 

^ Readers unfamiliar with the classical limit might find loss of the quantum uncertainty of the theory counterintuitive 
and discordant with the loss of information involved. Actually, the resolution to access the uncertainty is sacrificed in 
this limit. A standard consequence of the Cauchy-Schwarz inequality for Wigner functions is |/| < 2//i, [T^], reflecting 
the uncertainty principle: the impossibility of localizing / in phase space, through a delta function. The best one 
can do is to take a pillbox cylinder of base h/2 and height 2//i, properly normalized to 1 = / dxdpf . Now, scaling 
the phase-space variables down and / up (to preserve this normalization — the volume of the pillbox, as in the above 
discussion of the offset) ultimately collapses the base of the pillbox to a mere point in phase space; and leads to 
a divergent height for /, a delta function, characteristic of a perfectly localized classical particle. However, several 
different quantum configurations will reduce to this same limit: it is this extra quantum information on /i-dependent 
features, e.g. interference, that is obliterated in the limit. 
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Combined with Shannon's bound, this now amounts to 



0<S,<ln(fJ 



(9) 



i.e., the entropy is bounded above by an expression involving the variance of the corresponding 
classical limit distribution function. It readily generalizes to multidimensional phase space (-R^^, 
in which case the logarithm is evidently multiplied by A^, in evocation of Bekenstein's bound), 
and contexts where more information (e.g., on asymmetric variances) happens to be available, or 
refinement desired. 

By virtue of ([6]), the quantum entropy is recognized as an expansion 

n=l n=l 

The leading term, n = 1, 1— Trp^ = (1 — hf), is the impurity fH] \TU\ [12], often referred to as 
linear entropy. Like the entropy itself, it vanishes for a pure state [HI [TOl [12], for which = p, or, 
equivalently, f-kf = f /h. Each term in the above expansion then projects out p, or -khf, respectively: 
pure states saturate the lower bound on Sg. 

A likewise additive (extensive) generalization of the quantum entropy is the Renyi entropy [6], 

1 , ^ 1 , f dxdp ^ 



= ln(p"-^) = In / -r^ihf): , (11) 

1 — a I — a J n 

where the limit a — 1 yields -Ri = Sg, and the above-mentioned impurity is 1 — exp(— i?2)- For 
continuous distributions (infinity of components) discussed here, Rq is divergent. 

For a > 1, Ra > Ra+i, so Sg > Ra, and it is also bounded below by [6], i.e., 

Sg>Ra> Ra+1 > , (12) 

SO that, a fortiori, the Renyi entropy is also bounded by ([9]). 



3 Gaussian Illustration 



To illustrate the above inequalities, consider the Gaussian Wigner Function of arbitrary half- variance 



/(x,p,E) = ^^=e-^-''^(-^). (13) 

This happens to be the phase-space Wigner transform of a Maxwell-Boltzmann thermal distribution 
for a harmonic oscillator [13] , in suitably rescaled units, normalized properly to unity, and with mean 
energy E = {{x^ + p^) / 2) . 
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Calculation of the entropy of this distribution, is, of course, a freshman physics problem, but 
its independent phase-space derivation JW\ (also see is reviewed here, i.e., evaluation of (jl]) 

directly. 

For E = h/2, the distribution reduces to just /o, the Wigner Function for a pure state (the ground 
state of the harmonic oscillator). Hence [HI [12], 

fo^fo = j, (14) 

so that /o is ^-orthogonal to each of the terms in the sum ([6]), and hence Sg = 0, indicating saturation 
of the maximum possible information content. 

For generic width E, the Wigner Function / is not that of a pure state, but it still happens to 
always amount to a ★-exponential [16] {e^ = 1 + a + ai^ a/2! + a-k a-k a/3! + ...) as well, 

hf = e-4^+i'iWs) = g-|^(^'+p')+Micosh(/3/?i))^ ^^^^ 
where an "inverse temperature" variable j3{E,h) is useful to define, 

(Thus the above pure state /o corresponds to zero temperature, /3 = oo.) 



Since ^ir-f unctions, by virtue of their ^ir-expansions, obey the same functional relations as their non- 
■k analogs, inverting the ^i^-exponential through the ^ir-logarithm and integrating (jl]) yields directly the 
standard thermal physics result, 

5,(E,^) = |ln(^|±|) +iln((|)2-l) =^coth(/?/2)-ln(2sinh(/?/2)). (17) 

Indeed, this can be seen to be a monotonically nondecreasing function of E, attaining the lower 
bound for the pure state E — > h/2 (/? —> oc, zero temperature). 



The classical limit, h {13 ^ 0, infinite temperature) thus follows, 

Sg^l + \n{E/h) = ln(7re2E) -\nh = Sci{E) - In/i , (18) 

and is explicitly seen to bound the expression (ITTj) for all E, saturating it for large E » h, in 
accordance with Braunss' bound. That is, the upper bound ([9]) is saturated for Gaussian quantum 
Wigner functions with » h. 



Note the region E < h/2, corresponding to ultralocalized spikes excluded by the uncertainty 
principle, was not allowed by the above derivation method, since, in this region, no ^ir-Gaussian can 
be found to represent the Gaussian. (It would amount to complex P and Sg, hnked to thermal 
expectations of the oscillator parity operator.) 

NB. An alternate heuristic proposal of ref |3] for the classical limit of the entropy effectively starts 
from the Husimi phase-space representation [12j; it first effectively drops all -k^s in (jl]) and easily 
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evaluates ([T]) instead (which is well-defined because /// > automatically), before completing the 
transition to the classical limit — >■ 0. It also, ultimately, yields the same answer (ITS]) , since the 
Husimi representation of the Gaussian Wigner Function (1131) . 



is also a Gaussian. Utilized to evaluate ([T]), it yields ln(7re(2i? + h)), which has the more direct 
expression Sd of ffTSl) as its classical limit. (For the ground state, E = h/2, which is a coherent state, 
this semiclassical entropy reduces to a characteristic minimal value, 1 + Inh.) 



By virtue of ( 1151) . ^-powers of the Gaussian are also straightforward to take, and thus the Renyi 
entropies can be readily computed: 



1 / (2sinh(/j/2))" \ _ 1 ffE }_Y _ fE_lY\ 
" 1-a \2smh{aP/2))) a-1 \\h^2) [h 2)) 



(20) 



Note a — i> 1 checks with the above (fTTI) . -Ri Sg. Also, in the pure state limit, E = h/2, it 
is evident that Ra = checks for all a > 1. (For a > 1 and the small disallowed values E < h/2, 
< 0.) 

Ra is also a nondecreasing function of E; and, in comportance with (|T2l) . a nonincreasing function 
of a. Up to an additive, a-dependent constant, the classical limit is identical to that for the entropy 
itself, 

Ra - + HE/h) , (21) 

a — 1 

in agreement with the classical result of [8]. It may well be that, as in the contexts touched upon in 
the introduction, specific as may well provide more detailed or practical measures of complexity in 
Hawking radiation with sparse information available. 



// a specific quantum Hamiltonian were actually available for the system in question (a rare 
occurrence), then the classical limit of the entropy of the system would be straightforward — and thus 
the inequality discussed here would not be that powerful, since the classical entropy itself would be 
at hand, in general lower than the Shannon bound. 



For such a simple system, the upper-bounding classical entropy would result out of the phase- 
space partition function specified by the corresponding classical hamiltonian (the Weyl symbol of the 
quantum hamiltonian). This is easily illustrated explicitly by hamiltonians which are positive iV-th 
powers of the oscillator hamiltonian, so that, simply, 

/,,ocexp(-((x2+/)/2i?)A^). (22) 



The bounding classical entropy then reduces by standard thermodynamic evaluation to be just ([T]), 

(23) 
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lower than the cooresponding Shannon bound, 

l + lnLE^^±^) . (24) 

Note Added A referee has identified a technical gap in Braunss' formal proof of his inequality 
in [S], which is, nevertheless, assumed here. 
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